A NEW CONCEPT OF STRONG CONTROLLABILITY VIA THE 
SCHUR COMPLEMENT IN ADAPTIVE TRACKING 



BERNARD BERCU AND VICTOR VAZQUEZ 

Abstract. We propose a new concept of strong controllability associated with 
the Schur complement of a suitable limiting matrix. This concept allows us to 
extend the previous results associated with multidimensional ARX models. On 
the one hand, we carry out a sharp analysis of the almost sure convergence for 
', both least squares and weighted least squares algorithms. On the other hand, 

' we also provide a central limit theorem and a law of iterated logarithm for these 

, two stochastic algorithms. Our asymptotic results are illustrated by numerical 

(N . simulations. 

. 1. Introduction 

Consider the d-dimensional autoregressive process with adaptive control of order 
I {p, q), ARXd(p, q) for short, given for all > by 

(1.1) A{R)Xn+, = B{R)Un + e^+i 

where R stands for the shift-back operator and Xn, Un and e„ are the system output, 
input and driven noise, respectively. The polynomials A and B are given for all 2; G C 
by 

A{z) = Id-Aiz Apz'P, 

B{z) = h + B^z + --- + Bqz\ 

^ ! where Ai and Bj are unknown square matrices of order d and Id is the identity 

CN \ matrix. Denote by 6 the unknown parameter of the model 

3' 0^ = [Ai, . . . ,Ap,Bi, . . . ,B^). 

Relation (11.11) can be rewritten as 

(1.2) = e*<l>„ + f/„ + En+i 

X ; where the regression vector $„ = (X^, t/^J* with = (X* , . . . , -p+i) and 

■ = {Un, • • • 1 the sequel, we shall assume the (e„) is a martingale 

difference sequence adapted to the filtration F = (J-'n) where J-'n stands for the a- 
algebra of the events occurring up to time n. We also assume that, for all n > 0, 
E[e„+ie^^]^|jF„] = F a.s. where F is a positive definite deterministic covariance ma- 
trix. 

A wide literature concerning the estimation of 6 as well as on the tracking control is 
available, [1], [1], [5], [7], [8], [10], [12], [15]. The purpose of this paper is to establish 
sharp asymptotic results for stochastic algorithms associated with the estimation 
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of 6 via the introduction of a new concept of strong controllability. The strong 
controllability is closely related to the almost sure convergence of the matrix 



k=0 

In the particular case q = 0, it was shown in [5] that 

lim — = L a.s. 

n— »oo n 

where L is the block diagonal matrix of order dp given by 

L = diag(r,--- ,r). 

Under the classical causality assumption, we shall now prove that 
(1.3) lim — = A a.s. 

where A is the symmetric square matrix of order 6 = d{p + q) 

L 



A 



K H 



and the matrices H and K will be explicitly calculated. It is well-known [M] that 
det(A) = det(L) det(S') where S = H — KL~^K* is the Schur complement of L 
in A. Moreover, as L is positive definite, A is positive definite if and only if S is 
positive definite. Via our new concept of strong controllability, we shall propose a 
suitable assumption under which S is positive definite. It will allow us to improve 
the previous results [3], [B], [ID], [H] by showing a central limit theorem (CLT) and 
a law of iterated logarithm (LIL) for both the least squares (LS) and the weighted 
least squares (WLS) algorithms associated with the estimation of 6. 

The paper is organized as follows. Section 2 is devoted to the introduction of our 
new concept of strong controllability together with some linear algebra calculations. 
Sections deals with the parameter estimation and the adaptive control. In Section 
4, we establish convergence fll.Sp and we deduce a CLT as well as a LIL for both 
LS and WLS algorithms. Some numerical simulations are provided in Section 5. 
A short conclusion is given in Section 6. All technical proofs are postponed in the 
Appendices. 

2. Strong controllability 

In all the sequel, we shall make use of the well-known causality assumption on B. 
More precisely, we assume that for all 2; G C with < 1 

(Ai) det(S(z)) ^ 0. 

In other words, the polynomial det{B{z)) only has zeros with modulus > 1. Conse- 
quently, if r > 1 is strictly less than the smallest modulus of the zeros of det{B{z)), 
then B{z) is invertible in the ball with center zero and radius r and B~^{z) is a 
holomorphic function (see e.g. [S] page 155). For all ^ G C such that \z\ < r, we 
shall denote 



(2.1) P{z) = B-\z){A{z) - h) = ^F,^^ 



k=l 
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All the matrices may be explicitly calculated as functions of the matrices Ai and 
B,. For example, Pi = -Ai, P2 = B^Ai - A2, P3 = {B2 - Bl)Ai + B1A2 - A3. We 
shall often make use of the square matrix of order dq given, ii p> q, by 



/ P. 



P 



P 



p+i 



p-i 



P 



Pp+q~2 Pp+q~l \ 



p+l 



P 



p+q~2 



P. 



p~q+2 



P 



p-1 



P 



\ Pp-q+1 Pp-q+2 



P 



p-1 



p+l 



n 



while, ii p < q, by 



n 



Definition 2.1. An AKXd{p,q) is said to be strongly controllable if B is causal and 
n is invertible, 





Pp 


pp+1 




■ ■ ■ Pp+q-2 


Pp+q-1 






Pi 


P2 




■ ■ ■ Pq-1 


P, 









Pi 


P2 


■ ■ ■ Pq^2 






v 










Pi ■■■ 


Pp 





(A2 



det(n) ^ 0. 



Remark 2.1. The concept of strong controllability is not really restrictive. For ex- 
ample, if p = q = 1, assumption (A2) reduces to det(v4i) 7^ 0, if p = 2, = 1 to 
det(A2 - BiAi) 7^ 0, if p = 1, g = 2 to det(Ai) 0, while if p = g = 2 to 

. . f Ai A2- BiAi \ 

''''^ \A2- BrAr A3 - P1A2 + (P? - P2)Ai J ^ 

For all 1 < 2 < g, denote by Hi be the square matrix of order d 

00 

H, = Y, PkTPl 



k=i 



In addition, let H be the symmetric square matrix of order dq 

( H, 



(2.2) 



H 



H2 ■ ■ ■ Pg-l Hg \ 

Hi H2 ■ ■ ■ Pg-i 



Hg^l ■ ■ ■ H2 Hi H2 

\ Hi P*_i ■ ■ ■ Hi Hi J 



For all 1 < i < p, let K-i = PjF and denote by K the rectangular matrix of dimension 
dq X dp given, if p > g, by 



/ Ki K2 
Ki 



K 



Kp-2 Kp^i \ 

Kp-3 Kp_2 








Ki K2 
■■■ Ki 



K, 



p-q+l 



p-q 
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while, if p < q, by 



/ Ki ■■■ K. 





K 



p-2 Kp^i ^ 

























V ■■■ / 

Finally, let L be the block diagonal matrix of order dp 

/ r ■■■ \ 

r •■■ 



(2.3) 



L 



\ 
















r 
r 



(2.4) 



A 



and denote by A the symmetric square matrix of order 5 = d{p + q) 

L 

K H 

The following lemma is the keystone of all our asymptotic results. 
Lemma 2.2. Let S be the Schur complement of L in A 
(2.5) S = H - KL-^K\ 

If (Ai) and (A2) hold, S and A are invertible and 

Proof. The proof is given in Appendix A. 

3. Estimation and Adaptive control 



□ 



First of all, we focus our attention on the estimation of the parameter 9. We shall 
make use of the weighted least squares (WLS) algorithm introduced by Bercu and 
Duflo [3], [1], which satisfies, for all n > 0, 

(3.1) On+l =en + anS-\a)^n (^n+l - f/n - 

where the initial value 60 may be arbitrarily chosen and 

n 

Sn{a) = ^ak^k^l + Is 

k=0 

where the identity matrix Is with 6 = d{p + q) is added in order to avoid useless 
invertibility assumption. The choice of the weighted sequence (a„) is crucial. If 



we find again the standard LS algorithm, while if 7 > 

1 \ 1+7 



with 



dog Sn 

we obtain the WLS algorithm of Bercu and Duflo. 



fc=0 
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Next, we are concern with the choice of the adaptive control f/„. The crucial role 
played by Un is to regulate the dynamic of the process by forcing Xn to track 
step by step a predictable reference trajectory Xn- We shall make use of the adaptive 
tracking control proposed by Astrom and Wittenmark [1] given, for all n, > 0, by 

(3.2) = Xn+i - 

By substituting (13.21) into (11. 2p . we obtain the closed-loop system 

(3.3) Xn+l — Xn+l = Vr„ + £n+l 

where the prediction error iXn = {0 — 6n)^^n- In all the sequel, we assume that the 
reference trajectory (x„) satisfies 



o(n) a.s. 



(3.4) II II' 

k=l 

In addition, we also assume that the driven noise (e„) satisfies the strong law of 
large numbers which means that if 

n 



(3.5) r„ = -E-^^* 



n 

k=l 



then r„ converges a.s. to F. That is the case if, for example, (e„) is a white noise or 
if {£n) has a finite conditional moment of order > 2. Finally, let (C„) be the average 
cost matrix sequence defined by 



1 " 

Cn = — / (Xk — Xk){Xk 
n ' ' 



xkY- 

n ' 

k=l 



The tracking is said to be optimal if C„ converges a.s. to F. 

4. Main results 

Our first result concerns the almost sure properties of the LS algorithm. 

Theorem 4.1. Assume that the ARXd{p, q) model is strongly controllable and that 
{En) has finite conditional moment of order > 2. Then, for the LS algorithm, we 
have 

(4.1) lim — = A a.s. 

where the limiting matrix A is given by ^2.4\). In addition, the tracking is optimal 



(4.2) ||c„,_F„||=0(^) a.s. 



n 



We can be more precise in ( [^.^ by 
1 " 

(4.3) lim y^iXk -Xk- €k){Xk - Xk - SkY = ST a.s. 

n^r^ lOgn ^ ^ 



n— ►oo 

k=l 



Finally, On converges almost surely to 9 
(4.4) \\0^-ef=o(^^) a.s. 



n 

Our second result is related to the almost sure properties of the WLS algorithm. 
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Theorem 4.2. Assume that the ARXd{p, q) model is strongly controllable. In addi- 
tion, suppose that either (e„) is a white noise or (e^) has finite conditional moment 
of order > 2. Then, for the WLS algorithm, we have 

(4.5) lim(logn)i+^^^^ = A a.s. 

n^oo n 

where the limiting matrix A is given by ^2.4^ . In addition, the tracking is optimal 

(4.6) ||c„-r„||=o('(l2i!l):^) „,.. 



n 



Finally, On converges almost surely to 6 
(4.7) \\en-er=o(^^^^^] a.s. 



n 

Proof. The proof is given in Appendix B. □ 

Remark 4.1. One can observe that Theorems I4.1l and l4.2l extend the resuhs of Bercu 
[5] and Guo [11] previously estabhshed in the AR framework. 

Theorem 4.3. Assume that the ARX^ip, q) model is strongly controllable and that 
{Sn) has finite conditional moment of order a > 2. In addition, suppose that (a:„) 
has the same regularity in norm as (e^) which means that for all 2 < (3 < a 

n 

(4.8) II Xk f= 0{n) a.s. 

k=l 

Then, the LS and WLS algorithms share the same central limit theorem 

(4.9) v^(en-e) ^^^{o,A~'(g)T) 

where the inverse matrix A~^ is given by Ii2.6\) and the symbol ® stands for the 
matrix Kronecker product. In addition, for any vectors u & and v G M*^, they 
also share the same law of iterated logarithm 

1/2 ( n 



hmsup — — v^On -0)u = - hminf — — v\9n - 0)u 

2 log log n/ n^oo \ 2 log log n/ 



1/2 / ^_ \ 1/2 

a.s. 



(4.10) = [ii^K~^v) [v!Tu 
In particular, 

(4.11) ( < limsup ( —4 1 II - ^ f < i 

\\maxJ^J n^oo V21oglogny \\minJ^ J 

where Xmi-nX' one? Xmax^ ore the minimum and the maximum eigenvalues ofV. 
Proof. The proof is given in Appendix C. □ 

5. Numerical simulations 

The goal of this section is to propose some numerical experiments for illustrating 
the asymptotic results of Section 4. In order to keep this section brief, we shall only 
focus our attention on a strongly controllable ARXci{p, q) model in dimension d = 2 
with p = 1 and q = 1- Our numerical simulations are based on M = 500 realizations 
of sample size = 1000. For the sake of simplicity, the reference trajectory (a;„) is 
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chosen to be identically zero and the driven noise (£„) is a Gaussian A/'(0, 1) white 
noise. Consider the ARX2(1, 1) model 



where 



A 



Xn+l — AXn + Un + BUn~l + £n+l 

W 3 



2 
1 



and 



B 



4 V 



Figure 1 shows the almost sure convergence of the LS estimator On to the four 
coordinates of 9 which are different from zero. One can observe that On performs 
very well in the estimation of 9. 




200 400 600 BOO 1 OOO 




200 400 600 SOO 1 OOO 



Figure 2 
where A 



Figure 1. Left: LLN for A, Right: LLN for B. 

shows the CLT for the four coordinates of 

Zn = VnA^/\9n - 9) 
is the limiting matrix given by (12. 4p with L 



I2, K = and 



H = A^{l2 - B 



2\~1 



4 
21 



48 
7 



One can realize that each component of Zjy has A/'(0, 1) distribution as expected. 





Figure 2. Left: CLT for A, Right: CLT for B. 
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6. Conclusion 

Via our new concept of strong controllability, we have extended the analysis of the 
almost sure convergence for both LS and WLS algorithms in the multidimensional 
ARX framework. It enables us to provide a positive answer to a conjecture in [5] by 
establishing a CLT and a LIL for these two stochastic algorithms. In our approach, 
the leading matrix associated with the matrix polynomial B, commonly called the 
high frequency gain, was supposed to be known and it was chosen as the identity 
matrix Id- It would be a great challenge for the control community to carry out 
similar analysis with unknown high frequency gain and to extend it to ARMAX 
models. 



7. Appendix A. 

Proof of Lemma \2.^ Let S be the infinite-dimensional diagonal square matrix 

/ r \ 

r ■■■ 
•■■ r 



V 



Moreover, denote by T the infinite-dimensional rectangular matrix with dq raws and 
an infinite number of columns given, ii p> by 



T 



while, ii p < q, by 



Pp Pp+l 

Pp~l Pp 


■■ Pk 

Pk-1 


Pk+1 
Pk ■ 




Pp~q+2 Pp~q+3 " 
Pp-q+1 Pp-q+2 ■ 


■ ■ Pk-q+2 

■ ■ Pk-q+l 


Pk-q+3 ■ 
Pk-q+2 ■ 




Pp Pp+l 


■ Pk 


Pk+1 




Pi P2 

Pi P2 ■■ 


Pk-p+1 
Pk-p 


Pk-p+2 ■ 
Pfc-p+1 ■ 





v 



Pi Pa 

After some straightforward, although rather lengthy, linear algebra calculations, it 
is possible to deduce from (12. 5p that 

(A.l) S = TT.T\ 

It clearly follows from this suitable decomposition that 

(A.2) ker(5) =ker(r*). 

As a matter of fact, assume that V e belongs to ker(T*). Then, T^v = 0, 5v = 
which leads to ker(T*) C ker(S'). On the other hand, assume that v G M'^'' belongs 
to ker(S'). Since Sv = 0, we clearly have v'^Sv = 0, so v^TTiT'^v = 0. However, the 
matrix F is positive definite. Consequently, T^v = and ker(S') C ker(T*), which 
implies f lA.2p . Moreover, it follows from the well-known rank theorem that 

(A.3) dq = dim(ker(5)) + rank(5). 
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As soon as ker(S') = {0}, dim(ker(S')) = and we obtain from ( ]A.3[) that S is of full 
rank dq which means that S is invertible. Furthermore, the left hand side square 
matrix of order dq of the infinite-dimensional matrix T is precisely 11. Consequently, 
if n is invertible, 11 is of full rank dq, ker(n) = ker(n*) = {0} and the left null space 
of T reduces to the null vector of M.'^'^. Hence, if 11 is invertible, we deduce from 
f lA.2p together with (lA.SP that S is also invertible. Finally, as 

(A.4) det(A) = det(L) det{S) = det(rf det(5), 

we obtain from (lA.4p that A is invertible and formula fl2.6l) follows from [13] page 
18, which completes the proof of Lemma [2.21 □ 

Appendix B. 

Proof of Theorem 4-i In order to prove Theorem 14. ![ we shall make use of the 
same approach than Bercu [3] or Guo and Chen [TU]. First of all, we recall that for 
all n > 

(B.l) Xn+l — Xn+i = 7r„ + Sn+l- 

In addition, let 



Sr. 

It follows from fIB.ll) together with the strong law of large numbers for martingales 
(see e.g. Corollary 1.3.25 of |9]) that n = (9(s„) a.s. Moreover, by Theorem 1 of [2] 
or Lemma 1 of [101, we have 



(B.2) ^(1-AO II vTfc f=O(logs0 a.s. 

k=l 

where /„ = $^<5'~^$„. Hence, if has finite conditional moment of order a > 2, 
we can show by the causality assumption (Ai) on the matrix polynomial B together 
with (m that II f = O(s^) a.s. for all 2a-^ < (3 < 1. In addition, let 
gn = ^nS~\^n and 5„ = ti(S~\ — S:^^). It is well-known that 

(1-/„)(1 + (7„) = 1 

and tends to zero a.s. Consequently, as || tt^ |p= (1 — /n)(l + dn) \\ ||^ and 
1 + fi'n < 2 -|- 5„ II $„ IP, we can deduce from (IB. 20 that 

n 

(B.3) ^ II TTfc f = o{s^ logSn) a.s. 

k=l 

Therefore, we obtain from (13.41) . (IB.ip and (]B.3P that 

n 

(B.4) Yl II ^^^+1 ll'= ^(^nlog^n) + 0{n) a.s. 

k=l 

Furthermore, we infer from assumption (Ai) that 

(B.5) Un = B~\R)A{R)Xn+i - B~\R)en+i 

which implies by (]B.4p that 

n 

(B.6) II ll'= ^(^n + ^(^) 

fe=l 
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It remains to put together the two contributions ( ]B.4|) and ( 1B.6I) to deduce that 
Sn = o{sn) + 0{n) a.s. leading to s.„ = 0{n) a.s. Hence, it follows from ( ]B.3|) that 



(B.7) II 7Tk ||^= a.s. 

k=l 

Consequently, we obtain from (13.41) . fIB.ip and (IB. 71) that 

1 " 

lim -y^XkXl = r a.s. 

n— >oo 77, ' 
fc=l 

n 

and, for all 1 < z < p — 1, XkXl_^ = o{n) a.s. which implies that 

fc=0 

1 " 

(B.8) \un-J2xliXiy = L a.s. 



n^oo 77 

k=l 



where L is given by (12. 3p . Furthermore, it follows from relation (II. ip together with 
(IB.ip and assumption (Ai) that, for all n > 0, 

Un = B-\R)A{R)X.^+,-B-\R)e,,^,, 

= B~\R)A{R){7Tn + + B-\R){A{R) - 1^)6^+1, 
= K + W^n+i. 

Consequently, as Wn = P{R)£n, we deduce from (13.41) . (IB. 70 and the strong law of 
large numbers for martingales (see e.g. Theorem 4.3.16 of [H]) that, for all 1 < i < g, 

1 

lim - UkUl^i^-^ = Hi a.s. 

Ji— >oo 77 ^ 
k=l 

which ensures that 

(B.9) \un-J2umy = H a.s. 

k=l 

where H is given by (12. 2p . Via the same lines, we also find that 

1 " 

(B.IO) lim-5^X,^([/,%)* = K* 



a.s. 



n— >oo 77 

fc=l 



Therefore, it follows from the conjunction of (IB.Sp . (IB. 91) and (IB.lOp that 
(B.ll) lim — = A a.s. 

n— >oo 77, 

where the limiting matrix A is given by (12. 4p . Hereafter, we recall that the ARXd(p, q) 
model is strongly controllable. Thanks to Lemma [221 the matrix A is invertible and 
A~^, given by (12. 6p . may be explicitly calculated. This is the key point for the 
rest of the proof. On the one hand, it follows from (IB. lip that n = 0[\min{,Sn)\ 
II II ^= oin) a.s. which implies that tends to zero a.s. Hence, by (lB.2p . we find 
that 

n 

(B.12) ^ II TTfc f = C(logn) a.s. 

k=\ 
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On the other hand, we obviously have from ( IB.ip 



/ n 

[B.13) ||c„-r„||=o -V 

\ n ^-^ 

\ k=l 



■Kk-i f I a.s. 



Consequently, we immediately obtain the tracking optimality fl4.2l) from (1B.12P and 
(IB.lSp . Furthermore, by a well-known result of Lai and Wei (TS] on the LS estimator, 
we also have 

(B.14) \\l.+i-ef=Om^^) a.s. 

Hence (14.41) clearly follows from ( IB. Ill) and ( IB. 141) . Moreover, we also infer from 
Lemma 1 of Wei [17] together with (IB. lip that 

(B.15) - eySn(en+i -9) = o(logn) a.s. 

However, it follows from Theorem 4.3.16 part 4 of |9] that 

(B.16) hm -i- I - dYSn{en+i -e) + V(i - ftWi^U = r a.s. 

where = det{Sn). In addition, ii S = d{j> + g), we deduce from (IB. lip that 
(B.17) lim ^ = detA a.s. 

n— >oo n 

Finally, (IB.ISP together with (IB.16P and (IB.17P imply (14. 3 p , which achieves the proof 
of Theorem 14.11 □ 

Proof of Theorem \4.2\ By Theorem 1 of [1] , we have 

oo 

(B.18) ^an{l - fn{a)) \\ vr,, f < +oo a.s. 

n=l 

where /„(a) = a„$^S'~"'^(a)<l'„. Then, as = (log(s„))^+'>' with 7 > 0, we clearly 
have = 0{sn) a.s. Hence, it follows from (IB.lSp together with Kronecker's 
Lemma given e.g. by Lemma 1.3.14 of [9] that 

n 

(B.19) Yl II ll'= ^(^") ^-s- 

k=l 

Therefore, we obtain from ([S3D, (IRT]) and (IBIOP that 

n 

(B.20) Yl II ^'^+1 ll'= «(^") + a-s- 

fc=i 

In addition, we also deduce from assumption (Ai) that 

n 

(B.21) II ||'= o{sn) + 0{n) a.s. 

fc=i 

Consequently, we immediately infer from (lB.20p and (]B.2ip that s„ = o(s„) + 0{n) 
so Sn = 0{n) a.s. Hence, (1B.19P implies that 

n 

(B.22) Y II ^fc ll^= ^(^) a-s- 

k=l 
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Proceeding exactly as in Appendix A, we find from ( IB. 221) tliat 

lim — = A a.s. 

n— ►cxD fl 

Via an Abel transform, it ensures that 

(B.23) lim(logn)i+^^^^ = A a.s. 

n^oo fl 

We obviously have from flB.23P that /n(a) tends to zero a.s. Consequently, we obtain 
from flB.181) and Kronecker's Lemma that 



[B.24) 5^||7rfcf=o((logs„: 



^+^) a.s. 



fc=i 



Then, clearly follows from (!RT31) and (IRM . Finally, by Theorem 1 of [1] 
(B.25) \\l,+,-er=o( \ ) a.s. 

Hence, we obtain (14. 7p from (]B.23P and (lB.25p . which completes the proof of Theo- 
rem |4]2l □ 

Appendix C. 

Proof of Theorem \4.3\ First of all, it follows from ( 11. 2p together with ( 13. ip that, 
for all n > 1, 

(C.l) 9,,-e = S~\ia)M^{a) 

where 

n 

(C.2) Mn{a) = 9o-e + J2 dk-i^k-iel 

k=l 

We now make use of the CLT for multivariate martingales given e.g. by Lemma C.l 
of [5], see also [9], [13]. On the one hand, for the LS algorithm, we clearly deduce 
(14. 9 p from convergence (14.10 and decomposition fIC.ip . On the other hand, for the 
WLS algorithm, we also infer (14.90 from convergence (14. 5 p and fIC.ip . Next, we 
make use of the LIL for multivariate martingales given e.g. by Lemma C.2 of [5], 
see also [9], [16]. For the LS algorithm, since has finite conditional moment of 
order a > 2, we obtain from Chow's Lemma given e.g. by Corollary 2.8.5 of [TB] 
that, for all 2 < /3 < a, 

n 

(C.3) II f= 0{n) a.s. 

k=l 

Consequently, as the reference trajectory satisfies (14.80 . we deduce from flB.lO 
together with (lRT2l) and (ICl3|) that 



(C.4) II f= 0{n) a.s. 

k=l 

Furthermore, it follows from (IB.SP and (10.40 that 

n 

(0.5) II f = 0{n) a.s. 



k=l 
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Hence, we clearly obtain from ( 1C.4I) and ( IC.Sj) that 

n 

(C.6) II $fc f = a.s. 

fc=i 

Therefore, as /3 > 2, ( 1C.6I1 immediately implies that 

> 1=— < +00 a.s. 

n=l ^ * ' 

Finally, Lemma C.2 of [5] together with convergence (14. ip and fIC.ll) lead to (14.101) . 
The proof for the WLS algorithm is left to the reader because it follows essentially 
the same arguments than the proof for the LS algorithm. It is only necessary to add 
the weighted sequence (a„) and to make use of convergence (14.51) . □ 

References 

[1] K. J. Astrom and B. Wittcnmark, Adaptive Control, 2nd edition, Addison- Wesley, New York, 
1995. 

[2] B. Bercu, Sur I'estimateur dcs moindres carres generalises d'un niodcle ARMAX. Application 
a I'identification des modeles ARMA. Annales de I'lnstitut Henri Poincare, 27, (1991), pp. 
425-443. 

[3] B. Bercu and M. Duflo, Moindres carres ponderes et poursuite. Annals de I'lnstitut Henri 

Poincare, 28 (1992), pp. 403-430. 
[4] B. Bercu, Weighted estimation and tracking for ARMAX models, SIAM J. Control Optim., 

33 (1995), pp. 89-106. 

[5] B. Bercu, Central limit theorem and law of iterated logarithm for least squares algorithms in 

adaptive tracking, SIAM J. Control Optim., 36 (1998), pp. 910-928. 
[6] B. Bercu and B. Portier, Adaptive control of parametric nonlinear autoregressive models via 

a new martingale approach, IEEE Trans. Automat. Control, 47, (2002), pp. 1524-1528. 
[7] P. E. Caines, Linear Stochastic Systems, John Wiley, New York, 1988. 

[8] H. F. Chen and L. Guo, Identification and Stochastic Adaptive Control, Birkhauser, Boston, 
1991. 

[9] M. Duflo, Random Iterative Models, Springer Verlag, Berlin, 1997. 
[10] L. Guo and H. F. Chen, The Astrom Wittenmark self-tuning regulator revisited and ELS- 

based adaptive trackers, IEEE Trans. Automat. Control, 36 (1991), pp. 802-812. 
[11] L. Guo, Further results on least squares based adaptive minimum variance control, SIAM J. 

Control Optim., 32 (1994), pp. 187-212. 
[12] L. Guo, Self convergence of weighted least squares with applications to stochastic adaptive 

control, IEEE Trans. Automat. Control, 41 (1996), pp. 79-89. 
[13] P. Hall and C. C. Heyde, Martingale limit theory and its application. Academic Press, New 

York, 1980. 

[14] R. A. Horn and C. R. Johnson, Matrix Analysis, Cambridge University Press, New York, 
1990. 

[15] T. L. Lai and C. Z. Wei, Extended least squares and their applications to adaptive control 

and prediction in linear systems, IEEE Trans. Automat. Control, 31 (1986), pp. 898-906. 
[16] W. F. Stout, Almost sure convergence. Academic Press, New York, 1974. 
[17] C. Z. Wei, Adaptive prediction by least squares predictors in stochastic regression models with 
applications to time series. Annals of Statistics, 15 (1987), pp. 1667-1682. 
E-mail address: Bernard.Bercu@math.u-bordeauxl.fr 
E-mail address: Victor .Vazquezfisiu.buap.mx 

Universite Bordeaux 1, Institut de Mathematiques de Bordeaux, UMR 5251, 351 
couRS de la liberation, 33405 Talence cedex, France. 

Universidad Autonoma de Puebla, Facultad de Ciencias Fisico Matematicas, Avenida 
San Claudio y Rio Verde, 72570 Puebla, Mexico. 



